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Abstract 

We establish necessary optimality conditions for variational problems 
with an action depending on the free endpoints. New transversality con- 
ditions are also obtained. The results are formulated and proved using the 
recent and general theory of time scales via the backward nabla differential 
operator. 
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1 Introduction 

Physics and Control on an arbitrary time scale is an area of strong current 
research that unifies discrete, continuous, and quantum results and generalize 
the theory to more complex domains 2,6,20 . The new calculus on time scales 
has been applied, among others, in physics and control of population, quan- 
tum calculus, economics, communication networks, and robotic control (see [22) 
and references therein). The variational approach on time scales is a fertile 
area under strong current research [51 [71 fTTHT5l fT51 [T7T [T5] . In this paper we 
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study problems in Lagrange form with an action functional and a velocity vec- 
tor without boundary conditions x(a) and x(b). The considered problems are 
more general because of the dependence of the Hamiltonian on x(a) and x(b). 
Such possibility is not covered by the literature. Our study is done using the 
nabla approach to time scales, which seems promising with respect to applica- 
tions (see, e.g., [TJIH1H])- This work is motivated by the recent advancements 
obtained in [TD1[16] about necessary optimality conditions for the problem of 
the calculus of variations with a free endpoint x(T) but whose Lagrangian de- 
pends explicitly on x(T). Such problems seem to have important implications 
in physical applications [10 . In contrast with [TUHE], we adopt here a back- 
ward perspective, which has proved useful, and sometimes more natural and 
preferable, with respect to applications [TJ[3j[4j[l8j[2l]. The advantage of the 
backward approach here promoted becomes evident when one considers that 
the time scales analysis can also have important implications for numerical an- 
alysts, who often prefer backward differences rather than forward differences to 
handle their computations due to practical implementation reasons and also for 
better stability properties of implicit discretizations [T41I2T] . 

The paper is organized as follows. Section [2] presents the necessary defini- 
tions and concepts of the calculus on time scales; our results are formulated, 
proved, and illustrated through examples in Section [3] Both Lagrangian (Sec- 
tion !3.ip and Hamiltonian fSection l3.2p approaches are considered. Main results 
of the paper include necessary optimality conditions with new transversality 
conditions (Theorems 13.21 and I3.9[) that become sufficient under appropriate 
convexity assumptions (Theorem 13. 14|) . 

2 Time Scales Calculus 

For a general introduction to the calculus on time scales we refer the reader to 
the books [8)19] . Here we only give those notions and results needed in the sequel. 
In particular we are interested in the backward nabla differential approach to 
time scales [2Tj . As usual R, Z, and N denote, respectively, the set of real, 
integer, and natural numbers. 

A time scale T is an arbitrary nonempty closed subset of R. Thus, R, Z, 
and N, are trivial examples of times scales. Other examples of times scales are: 
[-1,4] UN, hZ := {hz\z G 1} for some h > 0, q Nf > := {q k \k G N } for some 
q > 1, and the Cantor set. We assume that a time scale T has the topology that 
it inherits from the real numbers with the standard topology. 

The forward jump operator a : T — > T is defined by a(t) = inf {s G T : s > t} 
if t ^ supT, and er(supT) = supT. The backward jump operator p : T — > T is 
defined by p(t) = sup {s s T : s < t] if t ^ inf T, and p(inf T) = inf T. 

A point t G T is called right-dense, right-scattered, left-dense and left- 
scattered if a(t) — t, a {t) > t, pit) = t, and p(t) < t, respectively. We say 
that t is isolated if pit) < t < ait), that t is dense if pit) = t = <r(£). The 
(backward) graininess function v : T — > [0,oo) is defined by i/(t) = t — pit), 
for all ( 6 T. Hence, for a given t, v(t) measures the distance of t to its left 
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neighbor. It is clear that when T = M one has er(i) = t = p(t), and v(t) = for 
any t. When T = Z, a(t) —t + 1, p(t) = t — 1, and v{t) — 1 for any t. 

In order to introduce the definition of nabla derivative, we define a new set 
T K which is derived from T as follows: if T has a right-scattered minimum m, 
then T K = T \ {m}; otherwise, T K = T. 

Definition 2.1. We say that a function / : T — > R is nabla differentiable 
at t G T K if there is a number f v (t) such that for all £ > there exists a 
neighborhood U of t (i.e., f7 =]i — <5, t + 5[f)T for some 6 > 0) such that 

\f(p(t)) ~ f(s) - f V (t)(p(t) - s)\ < e\p(t) - s\, for all a G U. 

We call f v (t) the naWa derivative of / at i. Moreover, we say that / is nabla 
differentiable on T provided / v (i) exists for all t 6 T K . 

Theorem 2.2. (Theorem 8.39 in [8 ) Let T be a time scale, f : T — > R, arid 
i £ T K . If f is nabla differentiable at t, then f is continuous at t. If f is 
continuous at t and t is left- scattered, then f is nabla differentiable at t and 
f v (t) = ^^t_p(^*^ ■ Ift is left-dense, then f is nabla differentiable at t if and 
only if the limit lim s _>. t iMLJlll exists as a finite number. In this case, / v (t) — 
\im s ^ t m t Z f s {s) ■ Iff nabla differentiable at t, then f(p(t)) = f{t)-v{t)f v {t). 

Remark 2.3. When T = R, then / : R ->• R is nabla differentiable at t € R if 
and only if f v (t) = lim s ^ t tlihJisl exists, i.e., if and only if / is differentiable 
at t in the ordinary sense. When T = Z, then / : Z — > R is always nabla 
differentiable at t £ Z and f v (t) = Mzgp(*l) = f(t) - f(t - 1) =: Vf(t), i.e., 
V is the usual backward difference operator defined by the last equation above. 
For any time scale T, when / is a constant, then / v = 0; if f(t) = kt for some 
constant k, then / v = k. 

In order to simplify expressions, we denote the composition / o p by f p . 

Theorem 2.4. (Theorem 8.41 in [5]) Suppose f, g : T — > R are nabla differen- 
tiable at t £ T K . Then, the sum f + g : T — >• R is nabla differentiable at t and 
(/ + g) v (i) = + 5 V (t); /or any constant a, af : T — > R is nabla differen- 

tiable att and (a/) v (t) = a/ v (i); the product fg : T — > R is nabla differentiable 
at t and {fgf{t) = f v (t)g(t) + p{t)g*(t) = f v (t)g"(t) + f(t)g*(t). 

Definition 2.5. Let T be a time scale, / : T — > R. We say that function / is 
v -regressive if 1 — v(t)f(t) ^ for all G T K . 

Definition 2.6. A function F : T — > R is called a nabla antiderivative of 
/ : T — >■ R provided F v (t) = f(t) for all t G T K . In this case we define the nabla 
integral of / from a to 6 (a, 6 G T) by / a b /(t)Vf := F(b) - F(a). 

In order to present a class of functions that possess a nabla antiderivative, 
the following definition is introduced. 
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Definition 2.7. Let T be a time scale, / : T — > R. We say that function / 
is Id- continuous if it is continuous at left-dense points and its right-sided limits 
exist (finite) at all right-dense points. 

Theorem 2.8. (Theorem 8.45 in [5]) Every Id- continuous function has a nabla 
antiderivative. In particular, if a G T, then the function F defined by F(t) = 
fl f( T )^ T > i £ T, is a nabla antiderivative of f . 

The set of all ld-continuous functions / : T — > R is denoted by Cid(T, R), 
and the set of all nabla differentiable functions with ld-continuous derivative by 
C*(T,R). 



Theorem 2.9. (Theorem 8.46 in [S]) If f G C W (T,M) and t E T K , then 
hit 



/! (t) /(r)Vr = i/(i)/(i). 



Theorem 2.10. (Theorem 8.47 in|)//a, 6, c £ T, a < c < t, a £ M, and 

/, 5 G C W (T, R), then f a (f(t) + g(t)) Vt = /* f(t)\7t + J b a g(t)Vt; f a af(t)Vt = 

«/a/(*)vt/ Jj/Wv* = -J b a fWt; L a fWt = o; / a 6 /(*)vt = / Q c /(t)Vi + 

/ c b /(t)Vt. // /(*) >0foralla<t< b, then J* f(t)Vt > 0; / a b fP(t)g^(t)Wt = 
[(f9)(t)}t b a J" f v (t)g(t)Vt; j b a f(t)gV(t)Vt = [(fg)(t)]lZ b a - J b a f v (t)g p Wt. 

Remark 2.11. Let a, 6 G T and / G C W (T,R). For T = R, then J* f(t)Vt = 
J b f{t)dt, where the integral on the right side is the usual Riemann integral. 

f(t)Vt = Y /(*) if a < / /(*)Vi = if a = b, and 

i=o+l ^ a 

f f{t)Vt = - f(t)i£a>b. 
Ja t=b+i 

Let a, b G T with a < b. We define the interval [a, b] in T by [a, b] := 
{t 6 T : a < t < b). Open intervals and half-open intervals in T are defined 
accordingly. Note that [a,b] K = [a,b] if a is right-dense and [a, b] K = [a(a),b] if 
a is right-scattered. 

Lemma 2.12. ( [18 ) Letf,g G C ld ([a,b],R). Iff' (/(t)^(t) + <?(i)r? v (t)) V* = 
/or a/Z 77 G Cl d ([a, 6], R) swc/i i/ia£ 77(a) = 77(b) = 0, then g is nabla differentiable 
andg v (t) = f(t) VtG[a,b] re . 



3 Main Results 

Throughout we let A,B e T with A < B. Now let [a, b] be a subinterval of 
[A, £>], with a, b G T and A < a. The problem of the calculus of variations on 
time scales under our consideration consists of minimizing or maximizing 

,6 

C[x] = / f(t,x?{t),x v {t) 7 x{a),x(b))Vt, {x{a)=x a ), (x(b) = x b ) (1) 
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over all x £ C} d ([A, b], R). Using parentheses around the endpoint condi- 
tions means that the conditions may or may not be present. We assume that 
f(t,x,v,z,s) : [A,b] x R 4 — > M has partial continuous derivatives with respect 
to x, v, z, s for all t £ [A, b], and f(t, ■, ■, ■, ■) and its partial derivatives are ld- 
continuous for all t £ [A, b] . 

A function x £ Cl d ([A, 6],R) is said to be an admissible function provided 
that it satisfies the endpoints conditions (if any is given). Let us consider the 
following norm in C} d ([A, 6], R): \\x\\i = sup te[A b] \xP(t)\ + sup te[A b] \x v (t)\. 

Definition 3.1. An admissible function x is said to be a weak local minimizer 
(respectively weak local maximizer) for ([1]) if there exists S > such that C[x] < 
C[x] (respectively C[x] > C[x\) for all admissible x with ||x — < S. 



3.1 Lagrangian approach 

Next theorem gives necessary optimality conditions for the problem ([1]). 

Theorem 3.2. If x is an extremizer (i.e., a weak local minimizer or a weak 
local maximizer) for the problem then 

f^(t,xP(t),x^(t),x(a),x(b)) = f xP (t,xP(t),x v (t),x(a),x(b)) (2) 
for all t £ [a, b] K . Moreover, if x(a) is not specified, then 

f x v(a,x p (a),x v (a),x(a),x(b)) = / f z (t, x p (t), 5 V (<), x(a), x{b))Vt; (3) 

J a 

if x(b) is not specified, then 

r b 

f x v(b,xP(b),x v (b),x(a),x(b)) = - / / s (t,^(i),i V (t),5(a),i(6))Vi. (4) 



Proof. Suppose that L has a weak local extremum at x. We can proceed as 
Lagrange did, by considering the value of L at a nearby function x = x + eh, 
where e £ R is a small parameter, h £ Cj^QA, b], R). We do not require h{a) — 
or h(b) — in case x{a) or x(b), respectively, is free (it is possible that both are 
free). Let 

0(e) =L[(x + eh)(-)] 

rb 

f(t,x p (t) + sh(t),Z v (t) + eh v {t),x(a) + eh(a),x(b) + eh(b))Vt. 



A necessary condition for x to be an extremizer is given by 
WUo = 

l-b r 



/xp(- • • M*) + /,v (• • • )^ V (<) + /,(• • • )h(a) + /,(••• 



At = 0, 

(5) 
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where (•••)= (t, x p (t), x v (t), x(a),x(b)) . Integration by parts gives 

o = J" (/»,(• • •) - /Jv(- • • )) h»{t)m + h(b) ^v(- • . )|t= 6 + ^ /.(• • • )vtj 

+ %) |-/ x v(- ••)!*=»+ / /z(-)Vi ■ (6) 



We first consider functions such that ft,(a) = = 0. Then, by Lemma B.1 2[ 
we have 

M-)-/«v(-) = (7) 

for all i S [a, Therefore, in order for x to be an extremizer for the problem 
([U , x, must be a solution of the nabla differential Euler-Lagrange equation. But 
if x is a solution of ([7]), the first integral in expression ^ vanishes, and then 
the condition ([5]) takes the form 

Kb) U v(---)|*=6 + J* / s (---)v^ 

+ %) ^-/xv(---)l*=a + ^ «-)Vtj =0. 

If :r(a) = x a and = Xf, are given in the formulation of problem ([1]), then 
the latter equation is trivially satisfied since h(a) = h(b) = 0. When x{a) is 
free, then © holds; when x(b) is free, then @ holds; since h(a) or h(b) is, 
respectively, arbitrary. □ 



Letting T = M in Theorem 13.21 we immediately obtain the corresponding 
result in the classical context of the calculus of variations. 

Corollary 3.3. (cf. PHIHE]) Let T = K. If x is an extremizer for 

= / f(t,x(t),x'(t),x(a),x(b))dt, (x(a) = x a ), (x(b) = x b ), 

J a 

then 

-f x . (t, x(t),x'(t),x(a), x(b)) = f x (t, x(t),x'{t),x(a), x(b)) 
for all t S [a,b]. Moreover, if x(a) is free, then 

f x >(a,x(a),x(a),x(a),x(b)) = / f z (t,x(t),x'(t),x(a),x(b))dt; (8) 

J a 

if x(b) is free, then 

f x ,(b,x(b),x'(b),x(a),x(b)) = - [ f s (t,x(t),x'(t),x(a),x(b))dt. (9) 
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Example 3.4. Consider a river with parallel straight banks, b units apart. One 
of the banks coincides with the y axis, the water is assumed to be moving parallel 
to the banks with speed v that depends, as usual, on the x coordinate, but also 
on the arrival point y(b) {y{b) is not given and is part of the solution of the 
problem). A boat with constant speed c (c 2 > v 2 ) in still water is crossing the 
river in the short possible time, using the point y(0) = as point of departure. 
The endpoint y(b) is allowed to move freely along the other bank x = b. Then 
one can easily obtain that the time of passage along the path y(x) is given by 

f b Vc 2 (l + (y'jx)) 2 ) - v*(x, y(b)) - v(x, y(b))y'(x) 

m = I dx ' 

where v = v(x, y{b)) is a known function of x and y(b). This is not a standard 
problem because the integrand depends on y(b). Corollary [531 gives the solution. 

Remark 3.5. In the classical setting / does not depend on x(a) and x{b), i.e., 
f z = and f s = 0. In that case |(SJ) and © reduce to the well known natural 
boundary conditions f x i (a,x(a),x'(a)) = and f x > (b,x(b),x'(b)) = 0. 

Similarly, we can obtain other corollaries by choosing different time scales. 
The next corollary is obtained from Theorem 13.21 letting T = Z. 

Corollary 3.6. If x is an extremizer for 

b 

L \ x ]= ^2 /(*» — !)) ac(a),a:(6)), (x(o) = x a ), (x(b)=x b ), 

t=a+l 

then f x (t,x(t-l),Vx(T),x(a),x(b)) = Vf v (t, x(t - 1), Vx(t), x(a), x(b)) for 
all t £ [a + 1, b] . Moreover, 

b 

f v (a,x(a - 1), Vx(a),x(a),x(b)) = f z (t, x(t - 1), Vx(t), x(a), x(b)), 

t=a+l 

if x(a) is not specified and 

b 

f v (b,x{b-l),Vx{b),x(a),x(b)) = - fs(t,x(t-l),\7x{t) 7 x{a),x{b)), 

t=a+l 

if x(b) is not specified. 

Let T = <7 N °, q > 1. To simplify notation, we use V g for the g-nabla 
derivative: V q x(t) = ^ ■ 

Corollary 3.7. If x is an extremizer for 

L[x] = (l-q- 1 ) tf(t,x(q-H),V q x(t),x(a),x(b)), 
te(a,b] 

(x{a) = x a ), (x(b) = Xb), 
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then f x (t,x(q H),V q x(t),x(a),x(b)) = V q f v (t,x(q 1 t),V q x(t),x(a),x(b)) for 
all t 6 (a, b]. Moreover, if x(a) is free, then 

f v (a, x(aq~ 1 ),X7 q x(a),x{a), x(b)) 

= (l-q- 1 ) J2 tf z {t,x{q-H),V q x{t),x{a),x{b))-, 
te(o,6] 

if x(b) is free, then 

f v (b, V,i(6), i(a), x{b)) 

= -(l-q~ V ) tf s {t,K<T l t),V q x{t),x{a),x{b)). 

t£(a,b] 

We illustrate the application of Theorem 13.21 with an example. 
Example 3.8. Consider the problem 

minimize C[x] = [ ((x v {t)) 2 + ax 2 (0) + (3(x(l) - l) 2 ) Vt (10) 
Jo 

where a, (3 <E M + . If x is a local minimizer of (ITU1) . then conditions ©-(|1]) must 
hold, i.e., 

(2i V (*)) V =0, (11) 

2i v (0) = / 2ax(0)\7t, 2Z V (1) = - 2/3(x(l) - l)Vt. (12) 
./o Jo 

Equation (fTTj) implies that there exists a constant c £ 1 such that x v (t) = c. 
Solving this equation we obtain x(t) = ct + x(0). In order to determine c and 
x(0) we use the natural boundary conditions (|12[) which we can now rewrite as 
a system of two equations: 

c-ax(0)=0, c + /3(c + x(0) - 1) = 0. (13) 

The solution of (TTB")) is c = a+ ^ a ^ and ai(0) = a+ p +a/3 ■ Hence, x(t) — 
c(a, /3)t+x(0, a, /?) is a candidate for minimizer. We note that limQ^^oo c(a, j3) = 
1, limQ.^^00 x(0, a, j3) — 0, and in the limit a, /3 — > oo the solution of (fTU|) coin- 
cides with the solution of the following problem with fixed initial and terminal 
points: min£[:c] = f (x v (t)) 2j \7t, subject to a;(0) = and x(l) = 1. Expression 
ax 2 (0) + fi{x{\) — l) 2 added to the Lagrangian (x v (t)) 2 works like a penalty 
function when a and (3 go to infinity. The penalty function itself grows, and 
forces the merit function (|10[) to increase in value when the constraints x(0) = 
and x(l) — 1 are violated, and causes no growth when constraints are fulfilled. 
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1.4 



= P= 2 
= (3 = 4 
= /3 = 21 



20 



Figure 1: The extremal S(t) = c(a, f3)t + x(0, a, (3) of Example 13.81 for different 
values of parameters a and j3. 

3.2 Hamiltonian approach 

Now let us consider the more general variational problem of optimal control on 
time scales: to minimize (maximize) the functional 



where x a , x& 6 M, f(t, x, v, z, s) : [A, b] xK 4 -> K and g(t, x, v, z, s) : [A, b] xR 4 -> 
R have partial continuous derivatives with respect to x, v, z, s for all t G [A, 6], 
and /(£, •, •, •, •), g(£, •, •, •, •) and their partial derivatives are ld-continuous for all 
t. We also assume that the function g x is ^-regressive. 

A necessary optimality condition for problem (|14[) - (I15D can be obtained from 
a general Lagrange multiplier theorem in space of infinite dimension. We form a 
Lagrange function / + X p (g — x v ) by introducing a multiplier A : [A, b] — > R. In 
what follows we shall assume that A p is a nabla differentiable function on [a, b]. 
For examples of time scales for which the composition of a nabla differentiable 
function with p is not nabla differentiable, we refer the reader to [5]. Note that 
we are interested in the study of normal extremizers only. In general one needs 
to replace / in f + X p (g — x v ) by Ao/. Normal extremizers correspond to Ao = 1 
while abnormal ones correspond to Ao = 0. 




(14) 



subject to 



x v (t) = g(t,xP(t), U r(t),x(a),x(b)), 
(x(a) = x a ), (x(b) = Xb), 



(15) 
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Theorem 3.9. If (x,u) is a normal extremizer for the problem (|14p - (|15l) . then 
there exists a function p such that the triple (x,u,p) satisfies the Hamiltonian 
system 

x v (t) = H p (t,x"(t),uP{t),p(t),x(a),x(b)), (16) 
(p(t)) v = -H xP (t,xP(t),u?(t),p(t),x(a),x(b)), (17) 
the stationary condition 

H uP (t,xf(t),uP(t),p{t),x(a),x(b))=0, (18) 

for all t £ [a,b] K , and the transversality condition 

p(a) = - f H z (t, x"(t), u?(t),p(t), x(a), x(b))Vt, (19) 



when x(a) is free; the transversality condition 

P (b)= [ H s (t,x p (t),u?(t),p(t),x(a),x(b))Vt, (20) 

when x(b) is free, where the Hamiltonian H(t,x,v,p, z, s) : [A,b] x M 5 — > R is 
defined by 

H(t, x p , u p ,p, x(a), x(b)) = f(t, x p , u p , x{a),x(b)) + pg(t, x p ', u p , x(a),x(b)). 

Proof. Let (x,u) be a normal extremizer for the problem (|14|) — (|T5|) . Using the 
Lagrange multiplier rule, we form the expression A p (<? — x v ) for each value of 
t (we are assuming that T is a time scale for which A p is a nabla diffcrcntiable 
function on [a, b]). The replacement of / by / + \ p (g — x v ) in the objective 
functional gives us a new problem: minimize (maximize) 



Tlx, u, X] = 



A] = I {f(t,x p (t),u p (t),x(a),x(b)) 

+ X p (t)[g(t, x p (t), u p (t), x(a), x(bj) - x v (*)]} 



(21) 



(x(a) = x a ), (x(b) = x b ). 

Substituting 

H(t, x p , u p , X p , x(a),x(b)) = f{t, x p , u p , x(a),x(b)) + A p 5 (i, x p , u p , x(a),x(b)) 
into (|21[) we can simplify the new functional to the form 

2[x,u,X} = / [Hit,x p ,u p ,X p ,xia),xib)) - X P it)x v it)]Wt. (22) 

J a 

The choice of A p will produce no effect on the value of the functional I, as long 
as the equation X s7 it) = g{t, x p it), u p (t), x(a), x(b)) is satisfied, i.e., as long as 

x v it) = H XP it,x P it),u P it),X P it),x(a),x(b)). (23) 
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Therefore, we impose (f2l?f as a necessary condition for the minimizing (maxi- 
mizing) of the functional X. Under condition (1231) the free extremum of the X 
is identical with the constrained extremum of the functional C. In view of (|22[) . 
applying Theorem 13.21 to the problem (|2"TT) gives 

(X p (t)f = -H xP (t,xP(t),u»(t),\»(t),x(a),x(b)), (24) 

H uP (t,xP(t),uf>(t),\P{t),x(a),x(b)) = 0, (25) 
for all t G [a,6] K , and the transversality conditions 



A p (a) = - / iJ 2 (t,:r p (i),w p (i),A p (i),x(a),x(&))Vt, 

J a 

\P(b)= f H s (t,x"(t),uP{t),X"(t),x(a),x(b))Vt, 



(26) 



in case x{a) and x(b) are free. Note that (|2"4"|) is the first order nonhomogeneous 
linear equation and from the assumptions on / and g x , the solution A p exists 
(see Theorem 3.42 in [S]). Therefore the triple (x,u, A p ) satisfies the system 
(j2"3"]) - ([2~5l) and the transversality conditions (f2l)|) in case x(a) and x(6) are free. 
Putting p — A p we obtain the intended conditions (fT6)) - ([20)) . □ 



Remark 3.10. Theorem l3.9l covers the case when (x, u) is a normal extremizer for 
the problem (|14p - (ll5|) . We do not consider problems with abnormal extremizers, 
but in general such extremizers are possible. Let us consider the problem 

minimize C[x, u] = / (u(t)) 2 dt, 

x(0) = 0, x(l) = 

defined on T = K. Then, the pair (x(t), u(t)) = (0, 0) is abnormal minimizer for 
this problem. Observe that X[x{t),u(t), A] = for all A £ C x ([0, 1],R). However, 
for the triple (x(t),u(t), X(t)) = (t 2 - t,0,2f - 1) we have X[x(t),u(t),X(t)] = 
| 1 -(2t-l) 2 dt = -I<0. 



Example 3.11. Consider the problem 

r3 



minimize C[x, u] = [ (u p (t)) 2 + t 2 (x('S) - l) 2 + t 2 (x(0) - l) 2 Vt, 
Jo 

x v {t)=u p (t). 



(28) 



To find candidate solutions for the problem, we start by forming the Hamiltonian 
function 

H{t,x p ,u p ,p,x(0),x(3)) = {u p f + i 2 (x(3) - l) 2 +t 2 (x(0) - l) 2 +pu p . 
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Candidate solutions (x,u) are those satisfying the following conditions: 

(K*)) V = 0, u?(t) =.T V (t), 2u"(t)+p(t)=0, (29) 

p(0) = - / 2i 2 (x(0) - l)Vt, p(3) = / 2t 2 (x(3) - l)Vt. (30) 
Jo Jo 

From (j2"9"j) we conclude that p(t) = c and a possible solution is x(t) = — ^t + d, 

where c, d are constants of nabla integration. In order to determine c and d we 

use the transversality conditions (|30[) that we can write as 

c= - 2t 2 (d-l)Vt, c = ^ 2i 2 + tf-lj Vi. (31) 

The values of the nabla integrals in (|3"Tj) depend on the time scale. Notwith- 
standing this fact, substituting J Q 3 t 2 Vt = k, k e R, into (|3"Tj) we can simplify 
equations to the form 

c=-2fc(d-l), c = 2fc ^-y +<f- lj . (32) 

Equations (I3"2"j) yield c = and d = 1. Therefore, the extremal of the problem 
l[2"5|) is 3:(i) = 1 on any time scale. 

When T = M we obtain from Theorem 13.91 the following corollary. 

Corollary 3.12. Let (x,u) be a normal extremizer for 

,6 

L[x, u] = / f(t,x(t),u(t),x(a),x(b))dt 



subject to 

x'(t) = g(t,x(t),u{t),x(a),x(b)) 

(x(a) = x a ) (x(b) = x b ), 

where a, b £ K, a < b. Then there exists a function p such that the triple (x, u, p) 
satisfies the Hamiltonian system 

x'(t)=H x , p'(t) = -H x , 

the stationary condition 

H u = 0, 

for all t £ [a, b] and the transversality condition 

p(a) = - / H z dt, 

J a 



when x(a) is free; the transversality condition 



p(b)= f H s dt, 

J a 



when x(b) is free, where the Hamiltonian H is defined by 

H(t, x, u,p, z,s) = f(t, x,u,z, s) + p g(t,x,u, z, s). 



12 



(u(t)) 2 dt, , 
JJ (33) 



Wc illustrate the use of Corollary 13.121 with an example 
Example 3.13. Consider the problem 

minimize £{x,u] = J 

x'(t) = u(t) + x(-l)t + x(l)t. 

We begin by writing the Hamiltonian function 

H(t,x,u,p,x(-l),x(l)) = u 2 +p(u + x(-l)t + x(l)t). 

Candidate solutions (x,u) are those satisfying the following conditions: 

p'(t) = 0, (34) 

x'(t) = u(t) +x(-l)t + x(l)t, (35) 
2u(t) + p(t) = 0, (36) 



p(-l) = - / p(t)tdt, 



(37) 



P (l) = J p(t)tdt. 

The equation has solution pit) = c, —1 < t < 1, which upon substitution 
into ([5T|) yields 

ctdt = 0. 

-l 

From the stationary condition (|36p we get u(t) — 0. Therefore, C[x, u] = 0. 
Finally, substituting the optimal control candidate back into (l3"5j) yields 

x'(t)=x(-l)t + x(l)t. (38) 

Integrating equation (|38[) we obtain 

x(t) = ^t 2 (x(-l) + x(l))+d. (39) 

Substituting t — 1 and i = — 1 into (|3"9")l we get (i = and x(— 1) = x(l). 
Therefore, extremals of the problem (|33)l are x(t) = i 2 x(l), where x(l) is any 
real number. 

Theorem 3.14. Let (x p , u p , z, s) — > /(t, x p , u p , z, s) and (x p , m p , z, s) — >■ ^(t, x p , u 
be jointly convex (concave) in (x p ,u p ,z,s) for anyt. If(x,u,p) is a solution of 
system (|16[) - (|20[) and p(t) > /or aZZ t G [a, 6], i/ien (x, u) is a global minimizer 
(maximizer) of problem (|14 p - (|15p . 
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Proof. We shall give the proof for the convex case. Since / is jointly convex in 
(x p , u p ,z,s) for any admissible pair (x, u), we have 



£[x, u] — £[x, u) 



> 



b r 



[f(t, x»(t), u"(t), x(a), x(b)) - f(t, x"(t), u p (t), x(a), x(b))} Vt 

Up (t, xP{t),u?(t),x(a), x(b))(xP(t) - x p (t)) 

+ f uP (t, x p (t), u p {t), x(a),x(b))(u p (t) - u p (t)) 
+ f z (t, x p (t),u p (t), x(a),x(b))(x(a) - x(a)) 



+ f s (t, x p (t), u p (t), x(a),x(b))(x(b) - x(b)) 



Vt. 



Because the triple (x,u,p) satisfies equations (fTT|) - (j!?(I)) . we obtain 



£[x, u] — £[x, u 

fb r 

> 



p{t)g xP {- ■ ■ )(x p (t) - x p (t)) - (p(t)) A (x p (t) - x p (t)) 
- P(t)9u*(- ■ ■ )K(t) - u p (t)) - p{t)g z (- ■ ■ )(x(a) - x{a)) 



-p(t)g s (---)(x(b)-x(b)) 



Vt 



+ p{b){x(b) - x(b)) - p(a)(x(a) - x(o)), 

where(---) = (i, x p (t), u p (t), x(a), x(b)). Integrating by parts the term in (p) A 
we get 



£[x,u]-£[x,u]> / p{t) x v {t)-x y {t)-g xP {---)(x p {t)~x p (t)) 



- g uP (- ■ ■ )(u p (t) - u p {t)) - g z (. ■ ■ )(x(a) - x(a)) - g s (- ■ ■ )(x(b) - 5(6)) 
Using (Tip]) we obtain 



Vt. 



£{x, u] — £[x, u] 

> ( p{t)\g{t,x p (t),u p (t),x(a),x(b)) - g(t,x»(t),x p {t),x{a),x{b)) 

J a 

- g xP (- ■ ■ )(x p (t) - i p {t)) - g uP (- ■ ■ ){u p {t) - u p {t)) 



- 9z{- ■ ■ ){x{a) - x{a)) - g s (- ■ ■ )(x(b) - x(b)) 



Vt. 



Note that the integrand is positive due to p{t) > for all t £ [a, b] and joint 
convexity of g in (x 17 , u <T , z, s). We conclude that £[x,u] > £[x,u] for each 
admissible pair (x,u). □ 



14 



Example 3.15. Consider the problem (1331) in Example 13.131 The integrand 
is independent of (x, z, s) and convex in u. The right-hand side of the control 
system is linear in (u, z, s) and independent of x. Hence, 

x{t) = t 2 x{i), x(i)el, 
u(t) = 

gives, by Theorem l3.14[ the global minimum to the problem. 

Example 3.16. Consider again the problem from Example 13.81 Replacing x v 
by u p we can rewrite problem pU|) as 

minimize C[x, u] = f ((u p (t)) 2 + ax 2 (0) + j3(x(l) - l) 2 ) Vi 
Jo 

subject to x v (t) = u p (t). Function / is independent of x and convex in (u, z, s). 
The right-hand side of the control system is linear in u and independent of 
(x,z,s). Therefore, x(t) = c(a,f3)t + x(0,a,/3) is, by Theorem 13.141 a global 
minimizer of the problem. 
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